EDA Profile

Dataset statistics

Number of variables	40
Number of observations	30236
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	27
Duplicate rows (%)	0.1%
Total size in memory	9.2 MiB
Average record size in memory	320.0 B

Variable types

BOOL	20
NUM	17
CAT	3

Reproduction

Analysis started	2020-06-05 16:54:48.628481
Analysis finished	2020-06-05 16:55:41.352401
Duration	52.72 seconds
Version	pandas-profiling v2.8.0
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

Warnings

Dataset has 27 (0.1%) duplicate rows	Duplicates
`Number_of_announced_NLRI_prefixes` is highly correlated with `Number_of_announcements` and 1 other fields	High correlation
`Number_of_announcements` is highly correlated with `Number_of_announced_NLRI_prefixes` and 2 other fields	High correlation
`Average_edit_distance` is highly correlated with `Maximum_AS-path_length`	High correlation
`Maximum_AS-path_length` is highly correlated with `Average_edit_distance`	High correlation
`Maximum_AS-path_length_10` is highly correlated with `Maximum_edit_distance_7`	High correlation
`Maximum_edit_distance_7` is highly correlated with `Maximum_AS-path_length_10`	High correlation
`Maximum_AS-path_length_11` is highly correlated with `Maximum_edit_distance_8`	High correlation
`Maximum_edit_distance_8` is highly correlated with `Maximum_AS-path_length_11`	High correlation
`Maximum_AS-path_length_12` is highly correlated with `Maximum_edit_distance_9`	High correlation
`Maximum_edit_distance_9` is highly correlated with `Maximum_AS-path_length_12`	High correlation
`Maximum_AS-path_length_13` is highly correlated with `Maximum_edit_distance_10`	High correlation
`Maximum_edit_distance_10` is highly correlated with `Maximum_AS-path_length_13`	High correlation
`Maximum_AS-path_length_14` is highly correlated with `Maximum_edit_distance_11`	High correlation
`Maximum_edit_distance_11` is highly correlated with `Maximum_AS-path_length_14`	High correlation
`Maximum_AS-path_length_15` is highly correlated with `Maximum_edit_distance_12`	High correlation
`Maximum_edit_distance_12` is highly correlated with `Maximum_AS-path_length_15`	High correlation
`Number_of_Interior_Gateway_Protocol_IGP_packets` is highly correlated with `Number_of_announcements` and 1 other fields	High correlation
`Number_of_incomplete_packets` is highly correlated with `Number_of_announcements`	High correlation
`type` is highly correlated with `Anomalous`	High correlation
`Anomalous` is highly correlated with `type`	High correlation
`Number_of_announcements` is highly skewed (γ1 = 37.09375492)	Skewed
`Number_of_withdrawals` is highly skewed (γ1 = 55.31501153)	Skewed
`Number_of_announced_NLRI_prefixes` is highly skewed (γ1 = 29.32843764)	Skewed
`Number_of_withdrawn_NLRI_prefixes` is highly skewed (γ1 = 76.1167729)	Skewed
`Number_of_implicit_withdrawals` is highly skewed (γ1 = 21.9828425)	Skewed
`Number_of_Interior_Gateway_Protocol_IGP_packets` is highly skewed (γ1 = 35.34201326)	Skewed
`Number_of_Exterior_Gateway_Protocol_EGP_packets` is highly skewed (γ1 = 42.67050751)	Skewed
`Number_of_incomplete_packets` is highly skewed (γ1 = 37.74118142)	Skewed
`Number_of_duplicate_announcements` has 3191 (10.6%) zeros	Zeros
`Number_of_implicit_withdrawals` has 4576 (15.1%) zeros	Zeros
`Number_of_Exterior_Gateway_Protocol_EGP_packets` has 27309 (90.3%) zeros	Zeros
`Number_of_incomplete_packets` has 2446 (8.1%) zeros	Zeros

Number_of_announcements
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct count	939
Unique (%)	3.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	131.802950125678
Minimum	5
Maximum	24122
Zeros	0
Zeros (%)	0.0%
Memory size	236.2 KiB

Quantile statistics

Minimum	5
5-th percentile	30
Q1	52
median	81
Q3	143
95-th percentile	309
Maximum	24122
Range	24117
Interquartile range (IQR)	91

Descriptive statistics

Standard deviation	382.2452394
Coefficient of variation (CV)	2.900126583
Kurtosis	1874.825962
Mean	131.8029501
Median Absolute Deviation (MAD)	36
Skewness	37.09375492
Sum	3985194
Variance	146111.4231

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
50	360	1.2%
49	334	1.1%
58	331	1.1%
52	328	1.1%
59	322	1.1%
46	322	1.1%
57	318	1.1%
54	317	1.0%
42	317	1.0%
45	314	1.0%
Other values (929)	26973	89.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
5	1	< 0.1%
6	1	< 0.1%
8	1	< 0.1%
9	4	< 0.1%
10	7	< 0.1%

Value	Count	Frequency (%)
24122	1	< 0.1%
23656	1	< 0.1%
22261	1	< 0.1%
19336	1	< 0.1%
14996	1	< 0.1%

Number_of_withdrawals
Real number (ℝ_≥0)

SKEWED

Distinct count	44
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	7.3932067733827225
Minimum	0
Maximum	675
Zeros	26
Zeros (%)	0.1%
Memory size	236.2 KiB

Quantile statistics

Minimum	0
5-th percentile	3
Q1	5
median	6
Q3	8
95-th percentile	15
Maximum	675
Range	675
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	7.74733755
Coefficient of variation (CV)	1.047899482
Kurtosis	4201.011117
Mean	7.393206773
Median Absolute Deviation (MAD)	2
Skewness	55.31501153
Sum	223541
Variance	60.02123912

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
6	5906	19.5%
5	4955	16.4%
7	4141	13.7%
4	3260	10.8%
8	2352	7.8%
3	1509	5.0%
9	1120	3.7%
11	1004	3.3%
12	975	3.2%
10	890	2.9%
Other values (34)	4124	13.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	26	0.1%
1	137	0.5%
2	533	1.8%
3	1509	5.0%
4	3260	10.8%

Value	Count	Frequency (%)
675	1	< 0.1%
647	1	< 0.1%
510	1	< 0.1%
351	1	< 0.1%
329	1	< 0.1%

Number_of_announced_NLRI_prefixes
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct count	2259
Unique (%)	7.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	411.5626405609208
Minimum	6
Maximum	78495
Zeros	0
Zeros (%)	0.0%
Memory size	236.2 KiB

Quantile statistics

Minimum	6
5-th percentile	52
Q1	111
median	214
Q3	414
95-th percentile	1155.25
Maximum	78495
Range	78489
Interquartile range (IQR)	303

Descriptive statistics

Standard deviation	1272.639343
Coefficient of variation (CV)	3.092212989
Kurtosis	1275.875448
Mean	411.5626406
Median Absolute Deviation (MAD)	123
Skewness	29.32843764
Sum	12444008
Variance	1619610.897

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
100	132	0.4%
88	120	0.4%
108	119	0.4%
74	118	0.4%
86	115	0.4%
99	115	0.4%
95	113	0.4%
106	113	0.4%
60	113	0.4%
80	112	0.4%
Other values (2249)	29066	96.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
6	1	< 0.1%
11	1	< 0.1%
12	1	< 0.1%
13	4	< 0.1%
14	3	< 0.1%

Value	Count	Frequency (%)
78495	1	< 0.1%
66621	1	< 0.1%
63283	1	< 0.1%
56165	1	< 0.1%
41813	1	< 0.1%

Number_of_withdrawn_NLRI_prefixes
Real number (ℝ_≥0)

SKEWED

Distinct count	602
Unique (%)	2.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	64.27401111258104
Minimum	0
Maximum	82739
Zeros	26
Zeros (%)	0.1%
Memory size	236.2 KiB

Quantile statistics

Minimum	0
5-th percentile	7
Q1	17
median	30
Q3	54
95-th percentile	152
Maximum	82739
Range	82739
Interquartile range (IQR)	37

Descriptive statistics

Standard deviation	861.4705358
Coefficient of variation (CV)	13.4030928
Kurtosis	6392.129618
Mean	64.27401111
Median Absolute Deviation (MAD)	16
Skewness	76.1167729
Sum	1943389
Variance	742131.484

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
12	687	2.3%
19	663	2.2%
17	660	2.2%
15	657	2.2%
18	645	2.1%
14	641	2.1%
11	640	2.1%
13	638	2.1%
20	636	2.1%
24	632	2.1%
Other values (592)	23737	78.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	26	0.1%
1	55	0.2%
2	122	0.4%
3	170	0.6%
4	225	0.7%

Value	Count	Frequency (%)
82739	1	< 0.1%
78587	1	< 0.1%
62234	1	< 0.1%
42130	1	< 0.1%
40580	1	< 0.1%

Average_AS-path_length
Real number (ℝ_≥0)

Distinct count	7
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	6.171385103849715
Minimum	4
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	236.2 KiB

Quantile statistics

Minimum	4
5-th percentile	5
Q1	6
median	6
Q3	6
95-th percentile	7
Maximum	10
Range	6
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.6176362435
Coefficient of variation (CV)	0.1000806518
Kurtosis	1.581695649
Mean	6.171385104
Median Absolute Deviation (MAD)	0
Skewness	0.5895580897
Sum	186598
Variance	0.3814745292

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
6	20092	66.5%
7	6680	22.1%
5	2818	9.3%
8	583	1.9%
9	44	0.1%
10	10	< 0.1%
4	9	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
4	9	< 0.1%
5	2818	9.3%
6	20092	66.5%
7	6680	22.1%
8	583	1.9%

Value	Count	Frequency (%)
10	10	< 0.1%
9	44	0.1%
8	583	1.9%
7	6680	22.1%
6	20092	66.5%

Maximum_AS-path_length
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	34
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	13.117839661330864
Minimum	5
Maximum	107
Zeros	0
Zeros (%)	0.0%
Memory size	236.2 KiB

Quantile statistics

Minimum	5
5-th percentile	8
Q1	11
median	13
Q3	15
95-th percentile	19
Maximum	107
Range	102
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	3.577492145
Coefficient of variation (CV)	0.2727196122
Kurtosis	102.412865
Mean	13.11783966
Median Absolute Deviation (MAD)	2
Skewness	4.586089785
Sum	396631
Variance	12.79845005

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
12	4028	13.3%
11	3705	12.3%
13	3435	11.4%
14	3424	11.3%
10	2881	9.5%
15	2866	9.5%
16	2098	6.9%
9	1972	6.5%
17	1647	5.4%
8	1103	3.6%
Other values (24)	3077	10.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
5	5	< 0.1%
6	47	0.2%
7	522	1.7%
8	1103	3.6%
9	1972	6.5%

Value	Count	Frequency (%)
107	1	< 0.1%
106	1	< 0.1%
105	4	< 0.1%
104	1	< 0.1%
41	1	< 0.1%

Average_unique_AS-path_length
Real number (ℝ_≥0)

Distinct count	8
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	6.182365392247652
Minimum	4
Maximum	11
Zeros	0
Zeros (%)	0.0%
Memory size	236.2 KiB

Quantile statistics

Minimum	4
5-th percentile	5
Q1	6
median	6
Q3	7
95-th percentile	7
Maximum	11
Range	7
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.6172761461
Coefficient of variation (CV)	0.09984465603
Kurtosis	1.371464145
Mean	6.182365392
Median Absolute Deviation (MAD)	0
Skewness	0.5357796443
Sum	186930
Variance	0.3810298405

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
6	19862	65.7%
7	7006	23.2%
5	2751	9.1%
8	559	1.8%
9	44	0.1%
4	8	< 0.1%
10	5	< 0.1%
11	1	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
4	8	< 0.1%
5	2751	9.1%
6	19862	65.7%
7	7006	23.2%
8	559	1.8%

Value	Count	Frequency (%)
11	1	< 0.1%
10	5	< 0.1%
9	44	0.1%
8	559	1.8%
7	7006	23.2%

Number_of_duplicate_announcements
Real number (ℝ_≥0)

ZEROS

Distinct count	725
Unique (%)	2.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	34.776160867839664
Minimum	0
Maximum	5516
Zeros	3191
Zeros (%)	10.6%
Memory size	236.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	2
median	6
Q3	20
95-th percentile	185
Maximum	5516
Range	5516
Interquartile range (IQR)	18

Descriptive statistics

Standard deviation	119.8170179
Coefficient of variation (CV)	3.445377952
Kurtosis	378.5804252
Mean	34.77616087
Median Absolute Deviation (MAD)	5
Skewness	13.39534628
Sum	1051492
Variance	14356.11778

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	3218	10.6%
0	3191	10.6%
2	2733	9.0%
3	2234	7.4%
4	1833	6.1%
5	1457	4.8%
6	1182	3.9%
7	1036	3.4%
8	816	2.7%
9	741	2.5%
Other values (715)	11795	39.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	3191	10.6%
1	3218	10.6%
2	2733	9.0%
3	2234	7.4%
4	1833	6.1%

Value	Count	Frequency (%)
5516	1	< 0.1%
5008	1	< 0.1%
4445	1	< 0.1%
2769	1	< 0.1%
2724	1	< 0.1%

Number_of_duplicate_withdrawals
Real number (ℝ_≥0)

Distinct count	2094
Unique (%)	6.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	301.9616351369229
Minimum	0
Maximum	27624
Zeros	8
Zeros (%)	< 0.1%
Memory size	236.2 KiB

Quantile statistics

Minimum	0
5-th percentile	21
Q1	58
median	132
Q3	324
95-th percentile	1094
Maximum	27624
Range	27624
Interquartile range (IQR)	266

Descriptive statistics

Standard deviation	597.0329858
Coefficient of variation (CV)	1.97718159
Kurtosis	375.0461343
Mean	301.9616351
Median Absolute Deviation (MAD)	92
Skewness	12.84693036
Sum	9130112
Variance	356448.3862

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
35	189	0.6%
40	188	0.6%
28	180	0.6%
44	180	0.6%
37	177	0.6%
34	177	0.6%
55	176	0.6%
39	174	0.6%
50	173	0.6%
36	173	0.6%
Other values (2084)	28449	94.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	8	< 0.1%
1	16	0.1%
2	22	0.1%
3	14	< 0.1%
4	26	0.1%

Value	Count	Frequency (%)
27624	1	< 0.1%
25608	1	< 0.1%
21572	1	< 0.1%
14449	1	< 0.1%
13544	1	< 0.1%

Number_of_implicit_withdrawals
Real number (ℝ_≥0)

SKEWED
ZEROS

Distinct count	404
Unique (%)	1.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	20.0839066014023
Minimum	0
Maximum	3688
Zeros	4576
Zeros (%)	15.1%
Memory size	236.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	5
Q3	19
95-th percentile	78
Maximum	3688
Range	3688
Interquartile range (IQR)	18

Descriptive statistics

Standard deviation	64.78471609
Coefficient of variation (CV)	3.225702916
Kurtosis	854.6452715
Mean	20.0839066
Median Absolute Deviation (MAD)	5
Skewness	21.9828425
Sum	607257
Variance	4197.059439

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	4576	15.1%
1	3619	12.0%
2	2322	7.7%
3	2133	7.1%
4	1572	5.2%
5	1228	4.1%
6	1090	3.6%
7	925	3.1%
8	694	2.3%
9	604	2.0%
Other values (394)	11473	37.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4576	15.1%
1	3619	12.0%
2	2322	7.7%
3	2133	7.1%
4	1572	5.2%

Value	Count	Frequency (%)
3688	1	< 0.1%
3338	1	< 0.1%
2677	1	< 0.1%
2201	1	< 0.1%
1996	1	< 0.1%

Average_edit_distance
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	33
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	12.848524937161
Minimum	5
Maximum	107
Zeros	0
Zeros (%)	0.0%
Memory size	236.2 KiB

Quantile statistics

Minimum	5
5-th percentile	7
Q1	11
median	13
Q3	15
95-th percentile	19
Maximum	107
Range	102
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	3.748123368
Coefficient of variation (CV)	0.2917162387
Kurtosis	85.80269489
Mean	12.84852494
Median Absolute Deviation (MAD)	2
Skewness	3.927857268
Sum	388488
Variance	14.04842878

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
12	3897	12.9%
11	3490	11.5%
13	3367	11.1%
14	3252	10.8%
15	2768	9.2%
10	2710	9.0%
16	2037	6.7%
9	1919	6.3%
17	1575	5.2%
8	1188	3.9%
Other values (23)	4033	13.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
5	93	0.3%
6	643	2.1%
7	920	3.0%
8	1188	3.9%
9	1919	6.3%

Value	Count	Frequency (%)
107	1	< 0.1%
106	1	< 0.1%
105	4	< 0.1%
104	1	< 0.1%
34	6	< 0.1%

Maximum_edit_distance
Real number (ℝ_≥0)

Distinct count	184
Unique (%)	0.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	5.67575076068263
Minimum	0.1
Maximum	900.0
Zeros	0
Zeros (%)	0.0%
Memory size	236.2 KiB

Quantile statistics

Minimum	0.1
5-th percentile	0.5
Q1	0.9
median	1.5
Q3	2.8
95-th percentile	7.5
Maximum	900
Range	899.9
Interquartile range (IQR)	1.9

Descriptive statistics

Standard deviation	33.07775173
Coefficient of variation (CV)	5.82790773
Kurtosis	248.458843
Mean	5.675750761
Median Absolute Deviation (MAD)	0.7
Skewness	13.99376123
Sum	171612
Variance	1094.13766

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0.9	1877	6.2%
0.8	1814	6.0%
0.7	1662	5.5%
1.1	1602	5.3%
1	1475	4.9%
1.2	1384	4.6%
0.6	1332	4.4%
1.3	1137	3.8%
1.4	1020	3.4%
0.5	976	3.2%
Other values (174)	15957	52.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.1	5	< 0.1%
0.2	70	0.2%
0.3	187	0.6%
0.4	522	1.7%
0.5	976	3.2%

Value	Count	Frequency (%)
900	4	< 0.1%
800	5	< 0.1%
700	3	< 0.1%
600	12	< 0.1%
500	16	0.1%

Inter-arrival_time
Real number (ℝ_≥0)

Distinct count	12
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	6.233959518454822
Minimum	2
Maximum	15
Zeros	0
Zeros (%)	0.0%
Memory size	236.2 KiB

Quantile statistics

Minimum	2
5-th percentile	4
Q1	6
median	6
Q3	7
95-th percentile	8
Maximum	15
Range	13
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.215507679
Coefficient of variation (CV)	0.1949816445
Kurtosis	3.950632456
Mean	6.233959518
Median Absolute Deviation (MAD)	1
Skewness	-1.437071354
Sum	188490
Variance	1.477458917

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
6	13102	43.3%
7	10443	34.5%
5	2588	8.6%
8	2102	7.0%
2	1090	3.6%
3	375	1.2%
9	263	0.9%
4	232	0.8%
10	35	0.1%
11	4	< 0.1%
Other values (2)	2	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2	1090	3.6%
3	375	1.2%
4	232	0.8%
5	2588	8.6%
6	13102	43.3%

Value	Count	Frequency (%)
15	1	< 0.1%
12	1	< 0.1%
11	4	< 0.1%
10	35	0.1%
9	263	0.9%

Maximum_edit_distance_7
Boolean

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	26531
1	3705

Frequency Table

Value	Count	Frequency (%)
0	26531	87.7%
1	3705	12.3%

Maximum_edit_distance_8
Boolean

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	26208
1	4028

Frequency Table

Value	Count	Frequency (%)
0	26208	86.7%
1	4028	13.3%

Maximum_edit_distance_9
Boolean

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	26801
1	3435

Frequency Table

Value	Count	Frequency (%)
0	26801	88.6%
1	3435	11.4%

Maximum_edit_distance_10
Boolean

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	26812
1	3424

Frequency Table

Value	Count	Frequency (%)
0	26812	88.7%
1	3424	11.3%

Maximum_edit_distance_11
Boolean

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	27379
1	2857

Frequency Table

Value	Count	Frequency (%)
0	27379	90.6%
1	2857	9.4%

Maximum_edit_distance_12
Boolean

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	28138
1	2098

Frequency Table

Value	Count	Frequency (%)
0	28138	93.1%
1	2098	6.9%

Maximum_edit_distance_13
Boolean

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	28589
1	1647

Frequency Table

Value	Count	Frequency (%)
0	28589	94.6%
1	1647	5.4%

Maximum_edit_distance_14
Boolean

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	29574
1	662

Frequency Table

Value	Count	Frequency (%)
0	29574	97.8%
1	662	2.2%

Maximum_edit_distance_15
Boolean

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	29632
1	604

Frequency Table

Value	Count	Frequency (%)
0	29632	98.0%
1	604	2.0%

Maximum_edit_distance_16
Boolean

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	29851
1	385

Frequency Table

Value	Count	Frequency (%)
0	29851	98.7%
1	385	1.3%

Maximum_edit_distance_17
Boolean

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	29316
1	920

Frequency Table

Value	Count	Frequency (%)
0	29316	97.0%
1	920	3.0%

Maximum_AS-path_length_7
Boolean

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	29054
1	1182

Frequency Table

Value	Count	Frequency (%)
0	29054	96.1%
1	1182	3.9%

Maximum_AS-path_length_8
Boolean

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	28333
1	1903

Frequency Table

Value	Count	Frequency (%)
0	28333	93.7%
1	1903	6.3%

Maximum_AS-path_length_9
Boolean

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	27526
1	2710

Frequency Table

Value	Count	Frequency (%)
0	27526	91.0%
1	2710	9.0%

Maximum_AS-path_length_10
Boolean

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	26746
1	3490

Frequency Table

Value	Count	Frequency (%)
0	26746	88.5%
1	3490	11.5%

Maximum_AS-path_length_11
Boolean

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	26339
1	3897

Frequency Table

Value	Count	Frequency (%)
0	26339	87.1%
1	3897	12.9%

Maximum_AS-path_length_12
Boolean

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	26869
1	3367

Frequency Table

Value	Count	Frequency (%)
0	26869	88.9%
1	3367	11.1%

Maximum_AS-path_length_13
Boolean

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	26984
1	3252

Frequency Table

Value	Count	Frequency (%)
0	26984	89.2%
1	3252	10.8%

Maximum_AS-path_length_14
Boolean

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	27477
1	2759

Frequency Table

Value	Count	Frequency (%)
0	27477	90.9%
1	2759	9.1%

Maximum_AS-path_length_15
Boolean

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

0	28199
1	2037

Frequency Table

Value	Count	Frequency (%)
0	28199	93.3%
1	2037	6.7%

Number_of_Interior_Gateway_Protocol_IGP_packets
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct count	962
Unique (%)	3.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	126.8407527450721
Minimum	0
Maximum	22285
Zeros	31
Zeros (%)	0.1%
Memory size	236.2 KiB

Quantile statistics

Minimum	0
5-th percentile	26
Q1	47
median	73
Q3	137
95-th percentile	324
Maximum	22285
Range	22285
Interquartile range (IQR)	90

Descriptive statistics

Standard deviation	360.2402315
Coefficient of variation (CV)	2.840098499
Kurtosis	1734.362969
Mean	126.8407527
Median Absolute Deviation (MAD)	35
Skewness	35.34201326
Sum	3835157
Variance	129773.0244

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
50	369	1.2%
43	356	1.2%
48	346	1.1%
42	345	1.1%
52	343	1.1%
45	343	1.1%
51	337	1.1%
58	334	1.1%
46	334	1.1%
57	333	1.1%
Other values (952)	26796	88.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	31	0.1%
2	1	< 0.1%
4	1	< 0.1%
7	2	< 0.1%
8	3	< 0.1%

Value	Count	Frequency (%)
22285	1	< 0.1%
21801	1	< 0.1%
20454	1	< 0.1%
17860	1	< 0.1%
13797	1	< 0.1%

Number_of_Exterior_Gateway_Protocol_EGP_packets
Real number (ℝ_≥0)

SKEWED
ZEROS

Distinct count	47
Unique (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.2974930546368567
Minimum	0
Maximum	218
Zeros	27309
Zeros (%)	90.3%
Memory size	236.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	2
Maximum	218
Range	218
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	2.395954986
Coefficient of variation (CV)	8.053818229
Kurtosis	2913.915131
Mean	0.2974930546
Median Absolute Deviation (MAD)	0
Skewness	42.67050751
Sum	8995
Variance	5.740600297

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	27309	90.3%
1	1134	3.8%
2	857	2.8%
3	395	1.3%
4	212	0.7%
5	88	0.3%
6	62	0.2%
7	41	0.1%
8	22	0.1%
9	19	0.1%
Other values (37)	97	0.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	27309	90.3%
1	1134	3.8%
2	857	2.8%
3	395	1.3%
4	212	0.7%

Value	Count	Frequency (%)
218	1	< 0.1%
127	1	< 0.1%
107	1	< 0.1%
104	1	< 0.1%
79	1	< 0.1%

Number_of_incomplete_packets
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct count	196
Unique (%)	0.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	12.917052520174627
Minimum	0
Maximum	1807
Zeros	2446
Zeros (%)	8.1%
Memory size	236.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	4
median	10
Q3	16
95-th percentile	32
Maximum	1807
Range	1807
Interquartile range (IQR)	12

Descriptive statistics

Standard deviation	29.03666698
Coefficient of variation (CV)	2.247932873
Kurtosis	1966.313662
Mean	12.91705252
Median Absolute Deviation (MAD)	6
Skewness	37.74118142
Sum	390560
Variance	843.1280294

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	2446	8.1%
3	1472	4.9%
6	1456	4.8%
5	1448	4.8%
7	1428	4.7%
4	1420	4.7%
2	1415	4.7%
8	1366	4.5%
10	1321	4.4%
11	1297	4.3%
Other values (186)	15167	50.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2446	8.1%
1	1143	3.8%
2	1415	4.7%
3	1472	4.9%
4	1420	4.7%

Value	Count	Frequency (%)
1807	1	< 0.1%
1796	1	< 0.1%
1777	1	< 0.1%
1450	1	< 0.1%
1210	1	< 0.1%

Packet_size_bytes
Real number (ℝ_≥0)

Distinct count	1506
Unique (%)	5.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	661.9944437094854
Minimum	0
Maximum	14975
Zeros	31
Zeros (%)	0.1%
Memory size	236.2 KiB

Quantile statistics

Minimum	0
5-th percentile	221
Q1	240
median	265
Q3	299
95-th percentile	506.5
Maximum	14975
Range	14975
Interquartile range (IQR)	59

Descriptive statistics

Standard deviation	1761.450626
Coefficient of variation (CV)	2.660823883
Kurtosis	17.52735114
Mean	661.9944437
Median Absolute Deviation (MAD)	28
Skewness	4.362501777
Sum	20016064
Variance	3102708.308

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
241	391	1.3%
240	384	1.3%
239	368	1.2%
234	367	1.2%
243	361	1.2%
238	357	1.2%
249	354	1.2%
244	351	1.2%
236	351	1.2%
250	350	1.2%
Other values (1496)	26602	88.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	31	0.1%
68	1	< 0.1%
81	1	< 0.1%
117	1	< 0.1%
121	1	< 0.1%

Value	Count	Frequency (%)
14975	1	< 0.1%
14243	1	< 0.1%
13971	1	< 0.1%
13957	1	< 0.1%
13697	1	< 0.1%

Anomalous
Categorical

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

-1	25243
1	4993

Common Values
Length

Value	Count	Frequency (%)
-1	25243	83.5%
1	4993	16.5%

Length

Max length	2
Median length	2
Mean length	1.834865723
Min length	1

type
Categorical

HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

normal	25243
anomaly	4993

Common Values
Length

Value	Count	Frequency (%)
normal	25243	83.5%
anomaly	4993	16.5%

Length

Max length	7
Median length	6
Mean length	6.165134277
Min length	6

category
Categorical

Distinct count	5
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	236.2 KiB

Code_Red_I	7200
Nimda	7200
Slammer	7200
RIPE_regular	7196
BCNET_regular	1440

Common Values
Length

Value	Count	Frequency (%)
Code_Red_I	7200	23.8%
Nimda	7200	23.8%
Slammer	7200	23.8%
RIPE_regular	7196	23.8%
BCNET_regular	1440	4.8%

Length

Max length	13
Median length	10
Mean length	8.713851038
Min length	5

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Count
Matrix

First rows

	Number_of_announcements	Number_of_withdrawals	Number_of_announced_NLRI_prefixes	Number_of_withdrawn_NLRI_prefixes	Average_AS-path_length	Maximum_AS-path_length	Average_unique_AS-path_length	Number_of_duplicate_announcements	Number_of_duplicate_withdrawals	Number_of_implicit_withdrawals	Average_edit_distance	Maximum_edit_distance	Inter-arrival_time	Maximum_edit_distance_8	Maximum_edit_distance_11	Maximum_edit_distance_12	Maximum_edit_distance_17	Maximum_AS-path_length_7	Number_of_Interior_Gateway_Protocol_IGP_packets	Packet_size_bytes	Anomalous	type	category
0	57	8	203	16	6	15	6	206	150	20	6	100.0	2	0	1	0	0	0	60	8079	-1	normal	BCNET_regular
1	62	23	361	75	6	16	6	398	355	120	6	1.1	3	0	0	1	0	0	68	9515	-1	normal	BCNET_regular
2	74	12	398	23	6	12	6	433	323	28	7	1.2	3	1	0	0	1	0	75	8632	-1	normal	BCNET_regular
3	70	4	543	49	6	27	6	568	210	72	8	1.1	3	0	0	0	0	1	72	9227	-1	normal	BCNET_regular
4	51	4	347	4	5	8	5	439	263	5	6	0.8	2	0	0	0	0	0	52	7831	-1	normal	BCNET_regular
5	72	16	469	53	6	12	6	539	336	86	6	1.2	3	1	0	0	0	0	77	8694	-1	normal	BCNET_regular
6	63	7	374	26	6	10	5	518	238	27	7	1.0	2	0	0	0	1	0	65	8040	-1	normal	BCNET_regular
7	77	15	554	188	6	16	6	699	473	583	7	1.3	3	0	0	1	1	0	79	9310	-1	normal	BCNET_regular
8	72	9	535	119	6	10	6	636	721	182	7	1.2	3	0	0	0	1	0	74	9180	-1	normal	BCNET_regular
9	61	9	268	64	5	10	5	293	146	68	6	1.0	2	0	0	0	0	0	63	7218	-1	normal	BCNET_regular

Last rows

	Number_of_announcements	Number_of_withdrawals	Number_of_announced_NLRI_prefixes	Number_of_withdrawn_NLRI_prefixes	Average_AS-path_length	Maximum_AS-path_length	Average_unique_AS-path_length	Number_of_duplicate_announcements	Number_of_duplicate_withdrawals	Number_of_implicit_withdrawals	Average_edit_distance	Maximum_edit_distance	Inter-arrival_time	Maximum_edit_distance_7	Maximum_edit_distance_8	Maximum_edit_distance_14	Maximum_edit_distance_15	Maximum_AS-path_length_7	Maximum_AS-path_length_10	Maximum_AS-path_length_11	Number_of_Interior_Gateway_Protocol_IGP_packets	Number_of_incomplete_packets	Packet_size_bytes	Anomalous	type	category
30226	28	1	44	1	6	8	6	1	24	0	8	0.4	6	0	0	0	0	1	0	0	19	9	219	-1	normal	Slammer
30227	29	4	93	18	7	12	7	0	45	5	12	0.5	6	0	1	0	0	0	0	1	28	1	266	-1	normal	Slammer
30228	47	6	76	12	6	11	6	1	44	2	11	0.8	6	1	0	0	0	0	1	0	42	5	221	-1	normal	Slammer
30229	61	5	137	27	7	19	7	13	68	10	19	1.1	7	0	0	0	1	0	0	0	59	2	248	-1	normal	Slammer
30230	51	4	79	6	6	19	7	6	64	1	19	0.9	7	0	0	0	1	0	0	0	50	1	220	-1	normal	Slammer
30231	44	5	90	21	6	18	6	13	58	2	18	0.8	6	0	0	1	0	0	0	0	39	5	243	-1	normal	Slammer
30232	21	1	39	1	6	11	6	0	13	0	11	0.3	6	1	0	0	0	0	1	0	18	3	222	-1	normal	Slammer
30233	17	3	49	6	6	11	6	0	11	0	11	0.3	7	1	0	0	0	0	1	0	16	1	241	-1	normal	Slammer
30234	27	5	58	7	6	19	6	4	19	1	19	0.5	7	0	0	0	1	0	0	0	20	7	223	-1	normal	Slammer
30235	24	7	43	15	6	19	6	3	12	2	19	0.5	6	0	0	0	1	0	0	0	21	3	218	-1	normal	Slammer

Most frequent

	Number_of_announcements	Number_of_withdrawals	Number_of_announced_NLRI_prefixes	Number_of_withdrawn_NLRI_prefixes	Average_AS-path_length	Maximum_AS-path_length	Average_unique_AS-path_length	Number_of_duplicate_announcements	Number_of_duplicate_withdrawals	Number_of_implicit_withdrawals	Average_edit_distance	Maximum_edit_distance	Inter-arrival_time	Anomalous	type	category	count
1	14	2	21	74	6	9	6	0	2	0	9	0.2	6	1	anomaly	Nimda	9
3	110	6	246	65	7	15	7	8	119	15	15	1.9	8	1	anomaly	Nimda	9
2	86	2	292	17	6	9	6	4	134	0	9	1.4	6	1	anomaly	Nimda	7
0	10	2	22	2	6	8	6	0	1	0	8	0.2	5	-1	normal	Nimda	6

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows

Duplicate rows

Most frequent